Note

Adds end-to-end support for accepting arbitrary JSON fields in IngestApi/Stream (TS index signatures, Python extra='allow') and passing them through to streaming functions, with validation, infra wiring, tests, and docs.

• Ingestion pipeline: arbitrary fields support
  • TS: Allow index signatures for IngestApi, Stream, and IngestPipeline (when table=false); inject allowExtraFields through TypedBase, Stream, IngestApi, and IngestPipeline.
  • PY: Treat dict[str, Any] and Any as JSON; detect Pydantic extra='allow' and emit allow_extra_fields in infra map.
  • Infra/Rust: Add allow_extra_fields to DataModel and ingest API wiring; enhance DataModelVisitor with pass-through for extra fields using streaming PassThroughSeed; route to Kafka unchanged.
  • Infra map: Carry allow_extra_fields from partial -> full map for ingress APIs.
• Compiler/validation
  • TS compiler plugin: toColumns option to allow index signatures; block IngestPipeline with table+index signatures; propagate flag into constructors.
• Tests & e2e
  • Add TS unit tests for index signature validation and extensive e2e tests (TS/PY) verifying extra fields pass to transforms and persist in UserEventOutput.properties.
  • Update expected schemas to include local.UserEventOutput (TS/PY variants).
• Docs
  • Document accepting arbitrary fields for TS (index signatures) and PY (extra='allow'), with transform examples.

^{Written by Cursor Bugbot for commit 40393f0. This will update automatically on new commits. Configure here.}